Newton's Method with a Model Trust Region Modification
نویسنده
چکیده
A modified Newton method for unconstrained minimization is presented and analyzed. The modification is based upon the model trust region approach. This report contains a thorough analysis of the locally constrained quadratic minimizations that arise as subproblems in the modified Newton iteration. Several promising alternatives are presented for solving these subproblems in ways that overcome certain theoretical difficulties exposed by this analysis. Very strong convergence results are presented concerning the minimization algorithm. In particular, the explicit use of second order information is justified by demonstrating that the iterates converge to a point which satisfies the second order necessary conditions for minimization. With the exception of very pathological cases this occurs whenever the algorithm is applied to problems with continuous second partial derivatives.
منابع مشابه
P , Sequential Quadratic Constrained Quadratic Programming
We follow the popular approach for unconstrained minimization, i.e. we develop a local quadratic model at a current approximate minimizer in conjunction with a trust region. We then minimize this local model in order to nd the next approximate minimizer. Asymptot-ically, nding the local minimizer of the quadratic model is equivalent to applying Newton's method to the stationarity condition. For...
متن کاملAn Eecient Trust Region Method for Unconstrained Discrete-time Optimal Control Problems 1
Discrete-time optimal control (DTOC) problems are large-scale optimization problems with a dynamic structure. In previous work this structure has been exploited to provide very fast and eecient local procedures. Two examples are the diierential dynamic programming algorithm (DDP) and the stagewise Newton procedure { both require only O(N) operations per iteration, where N is the number of times...
متن کاملExamination of Quadrotor Inverse Simulation Problem Using Trust-Region Dogleg Solution Method
In this paper, the particular solution technique for inverse simulation applied to the quadrotor maneuvering flight is investigated. The trust-region dogleg (DL) technique which is proposed alleviates the weakness of Newton’s method used for numerical differentiation of system states in the solution process. The proposed technique emphasizes global convergence solution to the inverse simulatio...
متن کاملA Two-dimensional Trust-region Method for Large Scale Bound-constrained Nonlinear Systems
We design a well-developed algorithm for solving large bound-constrained systems. The method combines a subspace trust-region strategy with a Newton-Krylov method and with a strategy for handling the bounds. To solve the trust-region problem efficiently, we look for an approximate solution and do not require the exact solution of the Newton equation. In addition, a strategy for obtaining an imp...
متن کاملTrust Region Newton Method for Large-Scale Logistic Regression
Large-scale logistic regression arises in many applications such as document classification and natural language processing. In this paper, we apply a trust region Newton method to maximize the log-likelihood of the logistic regression model. The proposed method uses only approximate Newton steps in the beginning, but achieves fast convergence in the end. Experiments show that it is faster than...
متن کامل